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The Path Integral Monte Carlo simulated Quantum Annealing algorithm is applied to the op- 
timization of a large hard instance of the Random 3-SAT Problem (N = 10000). The dynamical 
behavior of the quantum and the classical annealing are compared, showing important qualitative 
differences in the way of exploring the complex energy landscape of the combinatorial optimization 
problem. At variance with the results obtained for the Ising spin glass and for the Traveling Sales- 
man Problem, in the present case the linear-schedule Quantum Annealing performance is definitely 
worse than Classical Annealing. Nevertheless, a quantum cooling protocol based on field-cycling 
and able to outperform standard classical simulated annealing over short time scales is introduced. 

PACS numbers: 02.70.Uu, 02.70.Ss, 07.05. Tp, 03.67.Lx, 05.10.Ln, 75.10.Nr 



I. INTRODUCTION 

The aim of theoretical Quantum Computation is to un- 
derstand how the peculiar properties of quantum states 
can be exploited in order to encode and manipulate in- 
formation in a way which is quantitatively superior to 
classical computers jj| . The elementary unit of quantum 
information, the so-called qubit, is in general assumed 
to be a normalized vector in a Hilbert space TL spanned 
by two orthogonal eigenstates, conventionally labeled |0) 
and |1), and it is then completely determined by giving 
two real numbers (a component and a relative phase). 
In principle, a quantum computation can be seen as a 
sequence of appropriate unitary transformations operat- 
ing on sets of qubits, which requires having the quantum 
state of the system under control for a sufficiently long 
time. 

A completely different point of view is shared by a 
group of quantum computation paradigms that could be 
collectively referred to as Quantum Ground State Search 
techniques: two examples are given by the Quantum Adi- 
abatic Evolution technique and its variants 0- Q3- Q 13- El 
and by the semi-classical simulated Quantum Annealing 
algorithms ■ The basic idea common to all these 
approaches is to simulate the externally driven evolution 
of an artificial quantum system, whose ground states en- 
code in some way the solutions of specific computational 
problems. The underlying hypothesis is that a quantum 
system can dynamically explore the state space more ef- 
ficiently than its classical counterpart. The positive role 
played by quantum fluctuations has been verified in a 
number of different cases, both in real experiments [T(i| 
and in numerical simulations EJ ■ The Path-Integral 
Monte Carlo Quantum Annealing (PIMC-QA) algorithm 
has been applied with success, for instance, to the opti- 
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mization of instances of the Ising spin glass and of the 
Traveling Salesman Problem Here the quantum al- 
gorithm outperformed classical Simulated Annealing \H\ 
and the convergence time was significantly shorter, even 
after taking in account the extra cost of simulating a 
quantum computation on a classical computer 0, • 

Nevertheless, very few results of universal validity are 
known to date, and theoretical indications are poor and 
sometimes contradictory 0, 0, 0|- In particular, 
it has not been proved that a good quantum optimiza- 
tion pathway must always exist in general. In the cases 
in which a quantum procedure proved to be more effi- 
cient than the best classical one, the superior quantum 
performance cannot be explained quantitatively. 

In this paper, we will present a careful analysis of 
the PIMC-QA applied to a hard instance of the ran- 
dom MAX-3-SAT problem The main emphasis will 
not be on performance, but rather on understanding the 
properties that make simulated Quantum Annealing so 
different from its classical counterpart. Because we are 
here mainly interested in the comparison between algo- 
rithmic aspects, potentially relevant physical issues as 
the study of aging and memory/rejuvenation phenomena 
[lit Il7l | will not be addressed directly. 

The hardness of the chosen 3-SAT instance deserves 
some comments. It is common, in the quantum com- 
putation literature, to analyze the performance of newly 
introduced algorithms by testing them on simplified toy- 
problems of reduced size; this is essentially due to the 
demanding memory and time required by the classical 
simulation of a quantum computer. We decided instead 
to attempt the optimization of a true "competition prob- 
lem" , of a kind known to threaten seriously even the 
best heuristics known for the 3-SAT problem, namely 
WalkS AT Here smaller size problems might indeed 
still be difficult, but the dynamics would be dominated 
by large finite-size-fluctuation effects 0] and misleading 
indications could be obtained about the general prop- 
erties of the quantum optimization of a glassy energy 
landscape, which becomes really "hard" only in the ther- 
modynamical limit. 
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For a hard 3-SAT problem, one may wonder now if 
the quantum system is actually able to tunnel across the 
extensive walls encircling the deep and scattered ground 
state valleys. Here we expect that both classical and 
quantum annealing will be trapped by local minima lying 
well above the glassy threshold levels 0, |2£j , prevent- 
ing to access the very low-energy region where clustering 
of states takes place. The comparison between the sim- 
ulated classical and quantum relaxations will neverthe- 
less show that the two algorithms explore sectors of the 
phase space characterized by different geometrical prop- 
erties. As we shall see, the quantum pathways tend to 
visit basins of attraction with a considerably larger num- 
ber of flat directions and this feature will turn out to be 
highly counterproductive for an efficient optimization in 
the specific case of the 3-SAT landscape. The poor per- 
formance of quantum search techniques applied to the 
3-SAT problem, envisaged already in Ref. will then 
find here a striking confirmation. 

The paper is organized as follows. Sects. [H] and IIIII 
will give respectively a brief description of the combi- 
natorial optimization problem under study and of the 
employed algorithms. In Sec. If VI a first set of numerical 
experiments will be presented, while the analogy between 
PIMC-QA and genetic-like algorithms will be pointed out 
in Sec. [V] In Sec. IVII the differences between quantum 
and classical Monte Carlo dynamics will be highlighted 
by means of an autocorrelation analysis, and of a charac- 
terization of the landscape geometry. In Sec. IVIIl a more 
sophisticated cooling schedule will be introduced, allow- 
ing the quantum algorithm to outperform classical Sim- 
ulated Annealing, at least over short simulation times. 
In Sec. IVIIII finally, concluding comments about open 
problems and possible future lines of development will 
be presented. 



II. THE RANDOM 3-SAT PROBLEM 

Under many aspects, the 3-SAT problem can be con- 
sidered as the prototype of most of the hard combinato- 
rial optimization problems: 3-SAT was indeed the first 
problem for which a direct proof of NP-completeness 
was ever obtained. Since then, the easiest way of prov- 
ing the NP-completeness of some new problem has been 
to show its equivalence with some 3-SAT instance |l5j . 
Furthermore, 3-SAT is also of considerable practical rel- 
evance in many engineering applications, notably in the 
field of Artificial Intelligence and Automated Planning 

in in mm. 

In order to state the problem, consider a set of N 
boolean variables z\ 1 ■ ■ ■ , Zjsr, where Z{ = 1 or ('True' 
or 'False'). Denoting by Q the variable Zi or its nega- 
tion z~i, one then considers the disjunction (logical OR) 
of 3 variables C — (Q V Q V (fc), which is called a 3- 
clause. The random 3-SAT problem consists in deciding 
if the conjunction (logical AND) of M different clauses 
C\ A C% ■ • ■ A Cm - each clause being formed by 3 vari- 



ables extracted at random among the N available, and 
appearing negated or directed with uniform probability 
- can be simultaneously satisfied by a truth value as- 
signment {zi}. The optimization version of 3-SAT (the 
so called MAX-3-SAT problem) is obtained if one is in- 
terested only in finding a truth value assignment which 
minimizes the number of violated clauses. If we associate 
an Ising spin variable Si = (— l) Zi to each Boolean vari- 
able Zi, we can assign to any clause C a involving three 
variables Zi , Zj , Zk an energy E a given by 

„ _ (1 + Jg,iSi) (1 + JgjSj) (1 + Jg, k S k ) 



where the coupling J a ,i assumes the value -1 if the vari- 
able Zi appears negated in clause a, +1 otherwise. Ev- 
idently E a = if the corresponding clause is satisfied, 
E a = 1 otherwise. Therefore, each given realization of 
the M random clauses is associated to the Hamiltonian 
of a spin system with quenched disorder: 

M 

H({S i }) = J2 E a, (2) 

a=l 

which simply counts the number of violated clauses. No- 
tice that the same variable appears typically in more than 
one clause, sometimes negated, sometimes not, giving 
thus origin potentially to frustration. 

Statistical mechanics techniques can be used to deter- 
mine the phase diagram of the Random 3-SAT problem 
I2H |27| . The main parameter in this phase dia- 
gram (determining the hardness of a formula) is the ra- 
tio a — M/N between the number, M, of clauses and 
the number, N, of variables. The probability that a 
satisfying assignment exists becomes one in the thermo- 
dynamical limit for a < a c ~ 4.267, but vanishes for 
larger a's. Furthermore, for a c > a > oiq ~ 4.15, the 
ground-state configurations group in many clusters well 
separated among each other (one-step replica symmetry 
breaking (28|), hidden to any local search heuristic by an 
exponentially larger number of metastable states (thresh- 
old states). A lower bound to the energy of the threshold 
states acting as entropic traps is provided by the so-called 
Gardner energy [20| . 

Numerical experiments I29I l30l are in agreement with 
the analytical predictions |25l l26l |27| , and confirm that 
instances of random 3-SAT sampled in the vicinity of 
the SAT/UNSAT boundary a c are typically hard. The 
trapping effect induced by the threshold states cannot 
be neglected when the instance-size is large (N > 10000) 
and large statistical fluctuations become sufficiently rare 
jlflj . Smaller random formulas are, on the other hand, 
often easily solvable by classical simulated annealing. As 
already pointed out in the introduction, the efficiency of 
any new heuristics can then be significantly tested only 
over 3-SAT samples of a rather large size, which is con- 
siderably demanding for long quantum simulation times. 
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III. THE PATH-INTEGRAL MONTE CARLO 
SCHEME 

Let us consider the classical spin model described by 
the Hamiltonian J5J. In the well known classical Sim- 
ulated Annealing scheme ^H, the configuration of the 
system is randomly initialized at an initial temperature 
To and it is then updated according to, for instance, a 
standard Metropolis Monte Carlo rule: 



Pt (flip) = min 



1, exp 



(3) 



where Pt (flip) is the probability of accepting a given spin 
flip at time t, AE is the energy change induced by the 
flip and T t is the temperature at time t. The tempera- 
ture is gradually reduced according to a specific schedule 
that can be rather influent on the performance of the al- 
gorithm (see, for instance, Refs. |3l|,|32|). In the present 
paper we shall concentrate our attention on simple linear 
schedules, where the temperature is reduced by a fixed 
amount AT every S Monte Carlo complete sweeps of the 
systems (we chose S = 2 in our experiments, while AT 
was completely determined by the initial value T) and by 
the maximum number of iterations). This is not in gen- 
eral the best performing choice, but its simplicity makes 
the comparison with quantum annealing very transpar- 
ent. 

The classical Hamiltonian H.({Si}), in analogy with 
the Ising glass case pj |g] , can be turned into a quantum 
Hamiltonian, by substituting each classical Ising spin Si 
with the third component of a Pauli SU(2) spin operator 
erf , and by introducing a perturbing transverse field T: 



K 



Quantur 



(4) 



The T-dependent term plays the role of "kinetic energy" , 
inducing quantum fluctuations in the spin orientation. 
The basic idea of Quantum Annealing is to drive the sys- 
tem (0J toward its ground state by adiabatically varying 
the intensity of the perturbation field between two ex- 
tremal values To and Tf,- instead of gradually reducing 
the temperature, like in the case of thermal Simulated 
Annealing. 

In the Path Integral Monte Carlo (PIMC) scheme, 
the statistical-mechanical behavior of the quantum spin 
model Q is approximately turned into a classical simu- 
lation proble m by resorting to the Suzuki- Trotter trans- 
formation [33, 13 ■ us consider the following classical 
model with PN degrees of freedom: 

p p 
^=pT, H - J r E E ^,p^ p+1 (5) 



P =i 



p—l i 



The system (JjjJ can actually be seen as composed of P 
replicas (Trotter replicas) {Si tP , p = 1 • • -P} of the orig- 
inal classical configuration {Si} at an effective quantum 



temperature T q — PT, coupled among them by a nearest- 
neighbor transverse ferromagnetic coupling Jr. Periodic 
boundary conditions must be imposed along the trans- 
verse (Trotter) direction. The intensity of Jr is related 
to the strength of the quantum perturbation term and to 
the temperature T = T q j P by the following relation: 



T / r 

Jr = In tanh — — 

2 V PT 



> . 



(6) 



When P goes to infinity, the partition functions of the 
Hamiltonians Q and (J5J become identical, and the 
statistical-mechanical properties of the two systems be- 
come perfectly equivalent. One can then hope to simu- 
late the relaxation dynamics of (@J) by applying a classi- 
cal Metropolis algorithm to a Suzuki- Trotter transformed 
Hamiltonian in Eq. [S] |jj . The accuracy of the quantum 
simulation will increase for larger values of P, but the 
memory and time requirements will also increase accord- 
ingly. 

In the simplest possible Monte Carlo implementation, 
one tries to flip independently each of the PN spins of 
the equivalent classical system, but it is common [35| to 
perform in addition also global moves in which the spins 
Si lP corresponding to a given site i are simultaneously 
flipped in all the Trotter replicas (p — 1 ■ • • P) . This 
type of move does not affect the quantum kinetic energy 
contribution, but just the average classical energy. In a 
sense, the introduction of global moves allows to simulate 
a constant-temperature classical relaxation of the average 
classical energy, superimposed on the local modifications 
induced by quantum fluctuations at finite temperature. 

A schedule for the quantum algorithm must also be 
chosen. The principal drawback of the PIMC approach 
is the impossibility of simulating the quantum system di- 
rectly at zero temperature. For this purpose, other Quan- 
tum Monte Carlo schemes should be used, like the Green 
Function Monte Carlo method [3(|. The simplest possi- 
bility for a PIMC quantum annealing schedule is, once 
again, to linearly adjust the intensity of the transverse 
field between two given extremes Tq and Ff, while keep- 
ing the temperature T fixed at a constant value. More 
elaborated cooling protocols could be devised, but the 
linear strategy has been applied with success for the op- 
timization of the Ising spin glass JtJ and of the Traveling 
Salesman Problem (9(. Even for this very basic sched- 
ule, four parameters, (P, T, Tq, Tf), need to be tuned 
carefully in order to achieve a good performance. A 
more complex field-cycling schedule will be discussed in 
Sec. ED] 



IV. NUMERICAL EXPERIMENTS: 
COMPARING CLASSICAL AND QUANTUM 
ANNEALING 

Let us describe now a first set of numerical experi- 
ments, performed over a single 3-SAT random instance 
with N = 10 4 and a — 4.24, (i.e., right at the border 
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of the SAT/UNSAT transition), for several choices of an- 
nealing iterations and of Trotter replicas. The differences 
among random samples extracted from the same ensem- 
ble become negligible for such large sizes, and we can 
then carry out significant experiments without averaging 
over a large set of instances. 

Using an efficient ad-hoc algorithm (the WalkSAT 
heuristic supplemented by a message-passing procedure 
[TsL ITflj). we verified that the chosen formula (at a = 
4.24) was actually satisfiable, as expected from theory 
for a < a c . An empirical parameter tuning was then 
performed for the initial temperature To. In the case 
of linear-schedule Classical Annealing (CA), and fixing 
the maximum number of iterations, we conducted sev- 
eral experiments with different Tq. For To smaller than 
the optimal value T = 0.3 the strength of the thermal 
fluctuations induced in the system was too small, and the 
dynamics was trapped prematurely at an early stage. On 
the other hand, for initial values larger than the optimal 
value, too much time was wasted randomly wandering 
around the landscape at excessively high temperatures. 
A similar multi-parameter optimization was performed 
in the case of linear-schedule Quantum Annealing (Q A) . 
The best results were obtained by taking To ~ 0.7 and 
Tf ~ 0.001, independently from the choice of the number 
of replicas P. The optimal value of the effective quantum 
temperature T q = PT turned out to be 0.3, coincident 
with the optimal To for CA, a value evidently more re- 
lated to the statistics of the energy barriers of the formula 
landscape, than to the details of the relaxation pathway 
under consideration. 

A comparison between the performance of the optimal 
CA and the optimal QA at P — 50, both with and with- 
out global moves, is shown in Fig. ^ The graph shows 
the average residual energy (difference between the final 
energy reached by the algorithm and the konwn ground- 
state energy) as a function of the maximum number of 
total annealing iterations, ranging over several decades 
(from 10 2 to almost 10 6 ). In each point, an average has 
been taken over 50 different realizations of the same ex- 
periment; in the case of QA, a second average was per- 
formed among the energies of the P replicas, which are in 
general different. It can be seen that the linear-schedule 
CA always performs better than the linear-schedule QA, 
despite the improvement produced in the latter by the 
use of a large number of replicas (convergence is essen- 
tially reached for P > 100, see inset of Fig. ^ but we 
chose P = 50 to extend as much as possible the simula- 
tion time). The asymptotic slope of the linear-schedule 
QA curves seems indeed to be definitely less steep than 
that of CA, independently of the number of replicas in- 
volved in the simulation and of the use of global moves. 
This behavior is strikingly worse than that observed in 
both the Ising spin glass and the TSP cases 0, 0- A 
detailed study of the influence of landscape geometry 
might be helpful in order to achieve a better understand- 
ing of this different performance success. It should be 
remarked that large differences exist between the orga- 
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FIG. 1: Comparison between optimal linear-schedule Classi- 
cal (CA) and Quantum Annealing (QA) for a 3-SAT problem 
with N = 10 4 and a = M/N = 4.24. CA always performs 
better than QA simulated with P = 50 Trotter replicas. The 
average performance of linear QA is worse than that of CA, 
even if an improvement in the results can be obtained by in- 
troducing global moves (G) and by increasing P (in the inset 
the final average energy found by QA after 2000 iterations for 
increasing P is plotted and compared with the average result 
of a CA of the same length, dashed line) . The solid triangles 
are the data obtained by the field-cycling QA hybrid strategy 
described in Sec. IVHI 



nization of the optimal states in the combinatorial prob- 
lems analyzed so far. For instance, it is generally be- 
lieved that the ground state properties of the TSP [33 
are well described by a replica-symmetric Ansatz (all 
the ground state assignments are in a single broad val- 
ley), while replica-symmetry-breaking (i.e., clustering of 
ground states) is needed to achieve a good characteriza- 
tion of the 3-SAT zero-temperature properties [27|. Fur- 
thermore, the states visited by both CA and QA lie well 
above the glassy threshold (Gardner energy) for the 3- 
SAT instance, and very few details are known about the 
nature of such highly excited states. An attempt at char- 
acterizing the local topology of the visited configurations 
will be made in Sec. IV1I 



V. MONTE CARLO TIME DYNAMICS AND 
EVOLUTIONARY ANALOGY 

Let us now analyze in more detail the time-evolution 
of the energy during the annealing dynamics. We denote 
by ((E)) the configuration energy averaged over differ- 
ent experiments and Trotter replicas (this is the energy 
reported everywhere in Fig. ^) ; the average among differ- 
ent experiments of the best replica energy will be, on the 
other hand, denoted as (E). In Fig. [3 the Monte Carlo 
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FIG. 2: Energy evolution during Quantum Annealing, com- 
pared to Simulated Annealing. The variation of the averages 
(E) (average best replica) and ((E)) (average of the average 
replica) is shown as a function of the simulation time, for a set 
of experiments with P = 50 and a 2000 annealing iterations. 
The inset shows the time-dependent value of the coupling 
Jr. Three different regimes can be distinguished, which will 
be called quenching, search (driven by quantum fluctuations) 
and target selection. 



"time" evolution profiles of ((E)) and (E) are shown for 
a linear-schedule QA (2000 iterations long). 

The strength of the transverse field, and hence of 
the quantum coupling Jr given by Eq. @ (see inset of 
Fig. EJ), determines the relative importance of the classi- 
cal and quantum terms in the Hamiltonians I0J and JSJ, 
and its variation determines the transition between the 
three following observed regimes: 

1. (Quenching phase, T w Tq ~ 0.7, Jr — 0). The 
quantum system described by the Hamiltonian |@J| 
is quenched at temperature T q in presence of a 
strong external transverse field. The system enters 
an incoherent mixture of states. From the point 
of view of the PIMC simulation of Hamiltonian 
(JSJ, when the coupling Jr is small, each replica 
behaves as if roughly independent from the oth- 
ers. The algorithm is then effectively simulating P 
parallel Monte Carlo dynamic processes at a con- 
stant temperature T q . Both the local and global 
moves acceptances are extremely high in this tran- 
sient regime. The replicas assume different config- 
urations at similar energies, compatible with the 
quenching level at temperature T q . 

2. {Search phase). After the abrupt out-of- 
cquilibrium quenching phase, quantum features like 
delocalization, interference and tunneling should 
help the system to evolve towards attractive low- 



energy configurations. Looking at the Suzuki- 
Trotter Hamiltonian in Eq. with increasing 
coupling strength, the fluctuations of the different 
replicas become correlated. Some spin flips that 
would have been unlikely in absence of the replica- 
interaction term can now be accepted, thanks to the 
kinetic term, and several replicas can enter in con- 
figurations generally not visited by typical CA tra- 
jectories. The acceptance ratio is constantly higher 
than in the CA case and around the 25%, when con- 
sidering local moves. It is negligible, on the other 
hand, for global moves. 

3 {Target selection phase, r w Ty, Jr large). When 
the transverse field vanishes, quantum fluctuations 
are gradually switched off. The system selects then 
a low-energy target state and collapses completely 
into it. In this classical regime, when the transverse 
coupling Jr becomes very strong, only local spin 
flips tending to align the largest number of replicas 
can be accepted. All the replicas converge then to- 
wards the same configuration, corresponding to the 
one visited that has minimum energy, if the param- 
eters have been carefully tuned. The acceptance for 
local moves falls essentially to zero, but, if global 
moves are allowed, a further energy reduction of 
moderate entity can be observed thanks to small- 
range classical oscillations (the global moves accep- 
tance reaches now approximately the 20% level). 

Considering this three-piece scenario (that will be con- 
firmed by the autocorrelation and geometrical analysis 
of Sec. IVIf) . the simulated QA could be described as a 
very basic kind of evolutionary search |38[ l39j . The P 
replicas can be seen as a population of individuals, the 
spin configuration of each replica as its genotype, and 
the classical Hamiltonian © as a fitness function. The 
simulation is not simply equivalent to the selection of 
the best among P "restarts" |40j . because here contigu- 
ous replicas can "mate" , exchanging sequences of their 
genotype thanks to the duplicating action of the trans- 
verse coupling. A global decrease of the average fitness 
is induced by the proliferation of spin patterns typical of 
low-energy replicas (the so-called Holland schemata |4l|). 
Suppose now that some new exceptional individual ap- 
pears when Jr is already considerably large. The chance 
of survival of the spin pattern responsible of its supe- 
rior fitness would be rather small, because it would be 
overwritten with high probability by the corresponding 
subsequences in the most widespread configuration. The 
population tends then at a certain point to collapse to- 
ward a group of "identical twins" . Global moves cannot 
alter significantly this picture, because they do not cure 
the problem of the lack of genetic diversity. In standard 
evolutionary search, the available gene pool is constantly 
renewed by crossover techniques, but their introduction 
would not be physically justifiable in our PIMC scheme. 
However, one is in principle allowed to increase the muta- 
tion rate by switching on again the quantum fluctuations, 
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a strategy that will be investigated in Sec. IVIl| 1 



VI. AUTOCORRELATION ANALYSIS AND 
LANDSCAPE PROBING 

A better characterization of the dynamical behavior 
can be obtained by looking at the correlations among spin 
configurations at different times, and by probing the ge- 
ometry of the neighborhood of the visited configurations. 

Let us denote by {Si(t)} the instantaneous spin con- 
figuration of the sample 3-SAT-formula at time t. An 
autocorrelation function K{t 1 r) can be defined as: 

where an average over different realizations of the dy- 
namics (and over replicas in the QA case) has to be un- 
derstood. The autocorrelation function K(t, r) allows us 
to visualize in a compact way the typical behavior of the 
overlap between two spin assignments at different evolu- 
tion instants. In Figs.|2land0|we plot K(t, r) as a func- 
tion of the autocorrelation time r for several fixed values 
t* of the simulation time t, for the CA and QA dynam- 
ics, respectively (in the plots, t* is generally increasing 
from bottom to top, see later in this section). The re- 
sults shown are averaged over 500 different runs, each of 
2000 annealing iterations (and over P = 50 replicas, in 
the case of QA). A K(t*,r) which decays fast with r in- 
dicates that at time t* the configuration is still rapidly 
evolving, and that at every time-step a large number of 
spins is being flipped; when the local stability is reached, 
on the other hand, K(t*,r) assumes a flat (or periodic) 
profile, indicating that the system has entered into some 
attracting configuration (or limit cycle). 

Looking at Fig. |3 for CA, the self-overlap between 
{Si(t*)} and {Si(t* — r)} grows with t*. With increas- 
ing t* , a periodic behavior of K(t*,r) begins to appear 
over initially short but gradually increasing decay times 
t. In the final part of the classical relaxation, about 
20% of the variables are still allowed to flip at each iter- 
ation, even if the average energy is no longer changing. 
The strongly regular oscillations of K(t*,r), as well as 
the non-vanishing asymptotic spin flip acceptance ratio, 
suggest that the system gets trapped into a very small 
portion of the phase space, and that a fraction of the 
variables is still allowed to fluctuate, but only cyclically 
repeating a limited amount of sequences of flips. 

It is possible to characterize the states that are ac- 
tually blocking the system, by looking at the neighbor- 
hood geometry during the dynamics. When sitting in a 
configuration at a given energy E, one studies the en- 
ergy change AE upon flipping all the N spins: AE can 
be positive (uphill direction), vanishing (flat direction) 
or negative (downhill direction). The data relative to 
the configurations sampled by a large number of linear 
CA runs (each of 2000 annealing iterations, and always 
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FIG. 3: Autocorrelation function K(t* ,t) for CA. The dif- 
ferent curves represent the decay with r of several fixed- 
simulation-time snapshots of the autocorrelation function, for 
a CA experiment; t* is varying in the plot at fixed intervals 
between 200 and 2000, from bottom to top. 



over the same A?" = 10000 sample) are shown in Fig. |SJ 
where the fractions of downhill, flat and uphill directions 
are plotted (from top to bottom) against the energy of 
the visited configurations. One sees that the number of 
downhill directions falls to zero when the lowest energies 
are approached, indicating that the CA dynamics ends 
in a local minimum. The number of remaining flat direc- 
tions is compatible with the observed amplitude of the 
oscillations shown in Fig. [3] for large t*. 

Moving now to the analysis of QA, it must be remarked 
that during most of the simulation time the self-overlap 
among configurations at different times is considerably 
smaller than in the case of CA, and the spin-flip accep- 
tance ratio is larger. Both these properties hints at a 
regime characterized by a rapid and disordered evolution 
of all the replica spin-configurations. The self-overlap in- 
crease becomes faster upon reducing the transverse mag- 
netic field, because the pseudo-evolutionary replication of 
the "good" spin patterns, operated by the coupling JBJ, 
has also a stabilizing effect on them. If only local moves 
are performed (solid curves in Fig.^J, no trace of asymp- 
totic periodic behavior is found, and all the replica con- 
figurations reach continuously a full overlap with a sin- 
gle final configuration. When global moves are switched 
on, at large t*, after reaching a plateau of approximately 
0.93, the target selection phase starts, but now the self- 
overlap reduces slightly and damped classical-like oscil- 
lation set in. Looking at Fig. [5J it is possible to see that 
the states reached at the end of the QA schedule are very 
close to local minima, with an extremely small number of 
downhill directions. Once again, we assist to a trapping 
phenomenon, and the global moves can only produce a 
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FIG. 4: Autocorrelation function K(t*,r) for QA. The dif- 
ferent curves represent the decay with r of several fixed- 
simulation-time snapshots of the autocorrelation function, for 
QA experiments with and without global moves; t* is vary- 
ing at fixed intervals between 200 and 2000, from bottom to 
top. The target selection phase is characterized by a complete 
collapse into a single configuration, while damped classical os- 
cillations around the equilibrium position are allowed if global 
moves are introduced. 



local optimization around the final configuration reached 
when just local moves are used. Even if the diverging 
transverse coupling (and the consequent vanishing of the 
local acceptance) modifies in a noticeable way the behav- 
ior of the autocorrelation function, the blocking mecha- 
nism acting in the target selection phase of QA is then 
perfectly analogous to that of CA. 

Nevertheless, the analysis of the local geometry, shown 
in Fig. [SI highlights important differences between the 
CA and the QA dynamics. The phase space region ex- 
plored by the two algorithms are quite different. At the 
same value of the energy, the quantum system is vis- 
iting configurations with a significantly larger fraction 
of downhill and flat directions. If an abuse of language 
is tolerated, one could say that the CA follows narrow 
canyons, where the number of directions bringing to a 
decrease in energy is limited, while the QA prefers to 
explore the edges of mid-altitude plateaus. This phe- 
nomenon, which seems to be a genuinely quantum feature 
captured by the PIMC simulation, is strongly reminiscent 
of what happens in continuous space, where the choice of 
broader potential wells allow the system to reduce the ki- 
netic contribution to the total energy (curvature-induced 
effects are also well known in the theory of instanton tun- 
neling Quite interestingly, the typical number of 
spins which are different among the various Trotter repli- 
cas is of the order of the number of flat directions. This 
means that all the configurations simultaneously taken by 
the quantum system belong to a single broad landscape 
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FIG. 5: The local geometry of the visited regions of the phase 
space is probed by counting the fraction of directions in which 
the energy variation is negative, null or positive. Although 
both CA and QA get trapped in a local minimum, the quan- 
tum evolution tends to visit "valleys" that, at the same en- 
ergies than CA, are more flat and with a larger number of 
downhill directions. 



valley, which is explored in all its widencss by the quan- 
tum system. When the transverse field intensity is van- 
ishing, the target selection transition toward a classical 
regime takes place, and the number of uphill directions 
increases abruptly, indicating that the dynamical collapse 
is paralleled by a change in the local landscape topology. 
The poor performance of QA in the present 3-SAT case 
could be then explained by the existence of broad basins 
of attraction strewn with deceptive and highly attractive 
sinks, that, unlike the cleavages preferred from the very 
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FIG. 6: Energy evolution during a field-cycling hybrid strat- 
egy. The strength of the transverse coupling Jr is varied cycli- 
cally between the values 0.001 and 5, by adjusting the value 
of the magnetic field. The effective temperature T q is kept 
constant during each field ramp, but is reduced in a stepwise 
way among different ramps, from the initial value of 0.3 down 
to 0.05. Each ascending field-ramp unfreezes the system from 
a previously reached target state, and after a short transient 
regime, a new search phase is entered. The starting plateaus 
have energy values increasingly smaller than the quenching 
level at the new simulation temperature (the arrows in the 
graphs indicates the quenching level and the hybrid strategy 
plateau at a given value of the temperature) . Each new target 
state has a better energy than the preceding one, and the fi- 
nal average energy is better than the value reachable by large 
classical fluctuations. 



beginning by the CA, prevent access to lower energy sec- 
tors. To conclude, we remark that genetic-like search is 
also known to be strongly perturbed by the presence of 
multiple and scattered wells ^3 • 



VII. FIELD-CYCLING STRATEGIES 

After the final target selection, a new quantum search 
phase can be started by switching on again the field T 
and restoring then a regime dominated by quantum fluc- 
tuations. 

In a first possible experimental setup (results not 
shown), after a linear descending ramp from Tq ~ 0.7 
to Tf ~ 0.001, the field is raised smoothly to the initial 
value Tq and then back again to Tf, while keeping the 



effective quantum temperature T q = 0.3 constant. Many 
such field-cycles can be chained one after the other. It 
turns out that the linear-schedule QA dynamics is per- 
fectly time-reversible, and that all the ascending and de- 
scending ramps produce almost exactly the same time- 
evolutions for the energy (this phenomenon is somehow 
analogous to the well known memory and rejuvenation 
effects in glassy out-of-equilibrium dynamics [17]). 

Even if the restoration of quantum fluctuations allows 
the system to escape from the target local minimum, a 
further ingredient is needed in order to achieve better 
results. A possible expedient to avoid a complete re- 
initialization is to slightly reduce the temperature T be- 
fore each new field-ramp; the temperature is still kept 
constant during each individual ramp, realizing thus a 
hybrid strategy (a linear-schedule CA, superposed with 
linear-schedule QA cycles over a shorter time-scale). The 
time-dependence of the energy along a successful field- 
cycling scheme with a total length of 3100 MC iterations 

is presented in Fig. El The extrema (Tq\ F/'M of the z-th 
field-ramp are selected in order to have a smooth varia- 
tion of Jr , when the temperature changes discontinuously 
among two different ramps. The coupling is then varied 
regularly and cyclically between the values Jr,o — 0.001 
(corresponding to Tq ~ 0.7 when T q = 0.3) and Jr,/ — 5 
(corresponding to Tq ~ 0.001 when T q — 0.3). The tem- 
perature T q , finally is reduced from 0.3 to 0.05 as shown 
in the upper panel of Fig. [SJ Unlike the case of constant 
temperature field-cycling, after each ascending ramp and 
a short transient phase, we reach now new plateaus, ly- 
ing at a distance progressively larger from the energy 
level that would be obtained by performing a classical 
quenching at the same temperature (see the arrows in 
Fig. [SJ. Lower-lying target states are then selected after 
each descending ramp. Over short time scales (number of 
MC iterations approximately smaller than 200000, when 
taking P — 50), such a hybrid field-cycling strategy per- 
forms definitely better than a purely classical one. The 
same experiment has been repeated in absence of the 
transverse magnetic field, and with the same number of 
(now completely decoupled) Trotter replicas. The aver- 
age over the runs and over the Trotter replicas ((E)) CA , 
and the average over the runs of the best replica energy 
(£) have been computed. It is possible to see from 
Fig. [fj] that ((E)) hybrid obtained with the hybrid strat- 
egy lies clearly below (E) , indicating that quantum 
effects give access to states that can hardly be reached 
in the same time even by rare large classical fluctuations. 
Quantum restarts are then more effective than classical 
restarts ^(j> a ^ least when short schedules are taken in 
account. 

The analysis of purely classical cycling experiments 
confirms the importance of quantum fluctuations. The 
fact that (E) CA > ((E)) ^ brid shows already that the supe- 
rior performance is not simply due to the gradual reduc- 
tion of the initial temperature among the different ramps. 
Furthermore, the concatenation of short classical anneal- 
ings, each new one starting from a lower Tq and going 
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down to Tf = 0, provide a worse final energy than a sin- 
gle classical annealing of the same length. Indeed, even 
if the i-th descending classical annealing ramp (starting 

from Tq) produces a configuration with an energy lower 
than in the random case, the i-th fast ascending ramp 
to the temperature T (l+1) < T W of the (i + l)-th de- 
scending ramp completely erase now any positive effect. 
The system is indeed pushed at the energy level typical 
of a fast quenching at the temperature Tq 4+1 ^ and, unlike 
the quantum case, the memory of the previously visited 
low-energy configurations is completely lost. The pres- 
ence of the kinetic energy term is therefore crucial for the 
survival of "seed patterns" , peculiar of the target config- 
urations obtained at the end of the i-th descending ramp, 
from which new and better low-lying configurations can 
be grown during the following (i + l)-th stage. In the ge- 
netic algorithm jargon, one could say that the ascending 
ramps renew the available gene pool without destroying 
completely the highly fit genes of the preceding-step gen- 
eration. 

The situation is however different for larger time scales 
(MC iterations larger than 200000 for P = 50). Longer 
field-cycling schedules are obtained by simply rescaling 
with a constant factor the duration of all the ramps in 
a shorter schedule. The asymptotic slope of the field- 
cycling cooling curve in Fig. ^ becomes remarkably sim- 
ilar to the other QA cases. A local topology analysis 
analogous to the one of the previous section shows in- 
deed that the valleys explored by the field-cycling strat- 
egy are flat and open as the ones found in the simpler 
linear QA case. If the reduction of temperature allows 
the system to explore the landscape at different length 
scales Qj| and to find then better target configurations, 
the attractive power of the visited high-lying local min- 
ima continues to be very strong, and lower energy regions 
remain fundamentally inaccessible. 



VIII. DISCUSSION AND CONCLUSIONS 

We have conducted a detailed comparison of the per- 
formance of Path-Integral Monte Carlo (PIMC) Quan- 
tum Annealing (QA) strategies, against a standard ther- 
mal simulated annealing (CA) , on a very hard instance of 
a classical NP-complete problem, 3-SAT. Contrary to the 
successes previously obtained by the same technique on 
Ising spin glasses Hand on an instance of the Traveling 
Salesman Problem [9j , QA performs here definitely worse 
than CA: the ultimate large simulation time behavior of 
QA shows a poorer slope against inverse annealing rate 
than CA (see Fig. 1). 

In the course of this instructive negative example of 
QA performance (perhaps even more instructive because 
it is negative), we gained some experience and insight 
on the peculiar dynamical relaxation process behind the 
PIMC-QA algorithm. In particular, we saw, from over- 
lap autocorrelation analysis, that the quantum algorithm 



leads to "selection" , in the course of annealing, of a target 
configuration over which all the different replicas eventu- 
ally collapse, as the transverse coupling Jr induced by the 
quantum term —T J^. af grows to infinity. As a byprod- 
uct, we also realized that restarting repeatedly quantum 
fluctuations using such target configurations as interme- 
diate steps leads to a hybrid strategy that definitely im- 
proves over the bare linear schedule QA, with results 
comparable to CA for short simulation times. Neverthe- 
less, even with these considerable improvements of QA, 
the slope of the annealing curve seems to be essentially 
unaffected by refinements, and definitely worse than that 
of CA. This apparent "intrinsic" nature of the worse per- 
formance of PIMC-QA over CA suggests that the 3-SAT 
landscape (at least, when single spin- flip moves are con- 
sidered) is in some way more difficult for the quantum 
algorithm than for the classical one, presumably due to 
the fact that the flat and open landscape sectors that 
are peculiarly selected by the quantum relaxation bring 
in the 3-SAT case toward "dead ends" , hiding dangerous 
sink traps. 

Finally, we should stress that both PIMC-QA and CA 
are definitely worse than ad-hoc local search algorithms, 
notably WALKSAT [13]. One probably important fea- 
ture that is missing to both CA and PIMC-QA, but 
known to be important in WALKSAT and similar local 
heuristics, is the so-called focusing. That is the fact that 
the proposed random flips should be restricted to spins 
that are exclusively involved in currently UNSAT clauses 
(according to the rule of thumb "if it is not broken, don't 
fix it"). On the contrary, standard Metropolis sampling, 
as implemented in both PIMC-QA and CA, does not dis- 
criminate among the candidate spin flips, and only con- 
siders the corresponding energy change AE (see Eq. [2J . 
This suggests that a possible better way of implementing 
QA is through a Green's Function Monte Carlo (GFMC) 
algorithm, whereby a suitable kinetic term and appro- 
priate guiding functions, via importance sampling, can 
in principle take care of some form of focusing. Another 
important advantage of GFMC over PIMC would be the 
fact that annealing could be performed strictly at T = 0, 
whereas the unavoidably finite temperature T has clearly 
an influence on the PIMC-QA dynamics (see Fig. |BJ . 

In conclusion, while showing that statements such as 
"quantum is better" have not necessarily anything to do 
with physical reality - at least for arbitrary choices of 
the problem landscape and of the associated elementary 
moves -, our work still leaves many important questions 
open. One should strive for a reliable predictive theory 
that, taking as inputs the appropriate features of the 
complex energy landscape for the problem at hand, or for 
a class of problems, would be able to anticipate if, how, 
and where "quantum is better" . Closely connected with 
this is the ability in designing quantum kinetic Hamilto- 
nian terms that implement ad hoc local moves particu- 
larly efficient in exploring a given geometry. 

We thank Michal Kolaf , Mario Rasetti, Lorenzo Stella, 
Osvaldo Zagordi and Riccardo Zecchina for stimulating 
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